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Abstract 

In this paper, we study the minimal cost constrained input-output (I/O) and control configuration co-design 
problem. Given a linear time-invariant plant, where a collection of possible inputs and outputs is known a 
priori, we aim to determine the collection of inputs, outputs and communication among them incurring in the 
minimum cost, such that desired control performance, measured in terms of arbitrary pole-placement capability 
of the closed-loop system, is ensured. We show that this problem is NP-hard in general (in the size of the 
state space). However, the subclass of problems, in which the dynamic matrix is irreducible, is shown to be 
polynomially solvable and the corresponding algorithm is presented. In addition, under the same assumption, the 
same algorithm can be used to solve the minimal cost constrained I/O selection problem, and the minimal cost 
control configuration selection problem, individually. In order to illustrate the main results of this paper, some 
simulations are also provided. 


I. INTRODUCTION 

Real world systems, sueh as power systems, publie or business organizations, and large manufae- 
turing systems, are often too eomplex to be taekled by the elassieal paradigm of mostly eentralized 
deeision-making. Sueh systems are typieally eharaeterized by a multitude of deeision-makers; due to 
the distributed nature of the sensing model, in whieh no deeision maker may have a priori aeeess to the 
entire set of relevant data. Moreover, the eommunieations between the deeision-makers may be limited, 
as is the ease in almost all praetieal networked seenarios. This often rules out the possibility of all-to-all 
data exehange; henee, eentralized data proeessing and deeision-making. An alternative approaeh eonsists 
of deeentralization or deeentralized proeessing, in whieh the key idea is to equip the individual network 
deeision-makers with autonomous deeision-making abilities based on partial system data. 
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Clearly, the success of decentralized processing relies on carefully crafting the nature of partial data 
accessible to the local decision-makers (i.e., the information pattern). Therefore, in this paper, our goal 
is to identify the critical system locations to be monitored and controlled, and architect the required 
data exchange between the local components at minimal infrastructure and communication costs, desired 
closed-loop control performance may be achieved. The first set of steps in control systems design thus 
consist of addressing the following questions [1]: 

Ql Which actuators are required to ensure controllability? 

Q2 Which sensors are needed to ensure observability? 

Q3 What is the information pattern, i.e., which sensors need to supply data to which actuators, such 
that desired control objectives (for instance, stabilizability) may be ensured? 

In this paper, we address the input-output (I/O) selection problem (Q1-Q2), and the control con¬ 
figuration (CC) selection problem (Q3), with the additional constraint that different actuators, sensors 
and means-of-communication can incur in different costs. These costs can reflect manufacturing, main¬ 
tenance and installation costs, or selection preferences. For instance, consider the selection of phasor 
measurement units (PMUs) for state estimation in power electric grids [2], where sensor parameters 
such as sampling rate and choice of installation site may dramatically affect the cost, or leader selection 
problems in which some agents are preferred to others in executing some tasks [3]. Alternatively, the 
communication cost may be associated with the use of optic-fiber cable to forward data form sensors 
to actuators, hence, the cost would depend on its length. 

The major focus of the present paper involves the optimization and qualitative assessment of intrinsic 
system-theoretic constructs to achieve satisfactory cost-effective decentralized control. Specifically, in 
this cost-effective decentralized control context, we focus on the co-design of sensing-actuation infras¬ 
tructures and information patterns, i.e., which sensor outputs should communicate or be available to 
which actuators for feedback. 

Utilizing concepts from control theory, graph theory and combinatorial optimization, the major focus 
of the present paper involves the optimization and qualitative assessment of intrinsic system-theoretic 
constructs, as well as to develop new design/analysis tools and algorithms that can harness the physical 
dynamics of such systems to meet the specified large-scale control objectives’ guarantees. 

Related Work 

Recently, the I/O selection problem have received increasing attention in the literature, especially, since 
the publication of [4]. In [4], the minimal controllability problem (MCP), i.e., the problem of determining 
the sparsest input matrix that ensures controllability of a given the system dynamics matrix, was shown 


to be NP-hard, and some greedy algorithms provided. Exaet solutions to MCP are explored in [5], 
and in [6], using graph theoretical constructions, the minimal controllability problem is shown to be 
polynomially solvable for almost all numerical realizations of the dynamic matrix, satisfying a predefined 
pattern of zeros/nonzeros. Alternatively, in [7], [8], [9], [10] the configuration of actuators is sought to 
ensure certain performance criteria; more precisely, [7], [8], [10] focus on optimizing properties of the 
controllability Grammian, whereas [9] studies leader selection problems, in which leaders are viewed 
as inputs to the system, and the selection criteria aims to speed up convergence. In addition, in [9], [7], 
[8] the submodularity properties of functions of the controllability Grammian are explored, and design 
algorithms are proposed that achieve feasible placement with certain guarantees on the optimality gap. 
The I/O selection problem considered in the present paper differs from the aforementioned problems in 
the following two aspects: first, the selection of the inputs is restricted to belong to a specific given set 
of possible inputs, i.e., we study constrained input placement, and, hence, differing from [4], [5], [6] in 
which unconstrained input placement is studied. Secondly, it contrasts with [7], [8], [9], [10] in the sense 
that we do not aim to ensure performance in terms of a function of the controllability Grammian, but we 
aim to minimize the overall actuation cost, measured in terms of manufacturing/installation/preference 
costs. Furthermore, instead of optimizing a specific (numerical) system instance, we focus on structural 
design guarantees that hold for almost all (numerical) system instantiations with a specified dynamic 
coupling structure. In addition, within the scope of the present problem, we provide optimal solutions 
under mild assumptions on the dynamics of the system, under very general cost formulations. Note that, 
if we consider general dynamical systems, even with uniform cost, the problem tackled by us is NP- 
hard [11]. The latter problem is referred to as the minimal constrained input selection (CMIS) problem, 
i.e., the problem of determining the minimum number of inputs that ensures structural controllability, 
which has been extensively studied, see [12], [13] and references therein. In a sense, this provides 
justification for the traditional approaches to solve the FO selection problem, which include suboptimal 
methods such as heuristics, genetic algorithms or relaxations, see for instance [14], [15], [16], [17], 
[18], and references therein. 

Regarding the CC problem [14], it is worthy to point out that some meaningful advances were recently 
achieved in terms of determining the numerical gains to achieve closed-loop systems performance, given 
the existence of feasible informations patterns, that were accomplished by using convex optimization 
tools [19]. More precisely, the set of feasible solutions is often characterized in terms of a property 
called quadratic invariance, which has been subsequently shown to be necessary and sufficient [20], 
see also [21] for a review about the recent developments. Nevertheless, these methods always assume 
that there exists a feasible information pattern, and no restriction is imposed in terms of the sparsity or 


the cost incurred by a feasible information pattern. This is one of the goals of the present paper; in a 
sense, we can use the approach in the present paper to determine feasible information patterns that can, 
subsequently, be used to determine gains for numerical system instances using the existing tools. In 
[22] the design of wireless control networks is pursued, where given a decentralized plant, modeled as a 
discrete linear time invariant system equipped with actuators and sensors, the communication topology 
design between actuators and sensors to achieve decentralized control was posed as a CC selection 
problem. Both theoretical and computational perspectives were provided, although the CC selection 
problem admits a degree of simplification in the discrete time setting. The CC selection problem has 
also been considered in [23] where a method for determining the minimum number of essential inputs 
and outputs required for decentralization was provided; however, the characterization does not cope 
with all cases, see, for instance [24] (page 219). Another work that is related with ours is [25], which 
studies only the CC selection problem, for a given placement of inputs and outputs, i.e., the inputs and 
outputs do not incur in any cost. Furthermore, the methodology in [25] is not applicable when some of 
the communication costs are taken to be infinite, i.e., when a sensor cannot directly communicate with 
an actuator, as is often the case in many large-scale (possibly geographically distributed) systems. 

Nevertheless, as also referred in [14] there are very few methods that address the FO and CC 
problems jointly, and to the best of our knowledge none that considers general actuation/sensing and 
communication costs. Hereafter, we show that the problem is difficult (NP-hard) to solve in general, 
however, we identify an important subclass that admits polynomial complexity solutions. More precisely, 
we show that there exist efficient tools to address the FO and CC selection co-design when the dynamics 
matrix is irreducible. Notice that this comprises a variety of inter-connected dynamical systems [26], 
multi-agent networks [26], [27], or dynamics based in consensus-like protocols [28], [27], where the 
irreducibility is essentially ensured by the network connectivity. 

The closest work to the one presented in here, in the sense that it explores the I/O and control config¬ 
uration co-design problem, is the one in [6], where the sparsest I/O selection and control configuration 
problems, under the assumption that only the structure of the system dynamics is known but without 
constraints on the possible inputs/outputs, were addressed. An extension of [6] was presented in [29], 
where general (possibly heterogeneous) costs to actuate and measure state variables, but with uniform 
communication or feedback link cost, was considered. However, the I/O cost structure considered in [29] 
is somewhat different from that considered in this paper; in the former, the cost is imposed on the state 
variables that are to be actuated/observed and not on the specific actuators/sensors as considered in Vi 
in this paper. In summary, the present work differs from that presented in [6], [29] in the following 
three major aspects: (i) it considers additional constraints on the possible inputs and outputs used; (ii) 


the costs depend on the inputs and outputs used to perform a task; and (iii) the communication cost 
between input-output pairs is arbitrary. o 

The main contributions of this paper are as follows: (i) we show that the minimum cost constrained 
I/O and control configuration co-design problem is NP-hard; (ii) we present an efficient algorithmQ 
(polynomial in the dimension of the state, input and output) to solve it, when the dynamic matrix is 
irreducible; and (iii) we show how our solution, when the dynamic matrix is irreducible, can be used 
to solve the minimum cost constrained I/O selection problem, and the minimum cost CC selection 
problem, individually. 

The rest of the paper is organized as follows. In Section |nl we provide the formal problem statement, 
together with some motivation. Section HII] reviews some concepts and introduces results in structural 
systems theory. Subsequently, in Section |IV] we present the main technical results (proofs are relegated 
to the Appendix), followed by an illustrative example in Section |Vl Conclusions and discussions on 
further research are presented in Section |Vll 

II. Problem Statement 

In this paper, we consider a given (possibly large-scale) plant and a collection of inputs and outputs 
modeled by 

x{t) = Ax{t) -f Bu{t), y{t) = Cx{t), (1) 

where x{t) = [xi{t) ... Xn{t)]'^ G M", u = [ui{t) ... Up{t)]'^ G and y = [yi(t) ... ymi't)]'^ G M™' 

are the state, input and output, respectively. In addition, let A G {0,be the binary matrix that 
represents the structural pattern of A, and B G {0, C G {0, the structural patterns of the 

input and output matrices, respectively. Similarly, let K G {0, be the information pattern, where 

Ki^j = 1 if output j is available to actuator i, and zero otherwise. 

Further, we aim to ensure that a system achieves the specified large-scale control guarantees when 
the closed-loop system uses static output feedback, under communication constrains imposed by an 
information pattern. Specifically, by the careful design of FO and information pattern infrastructures, 
we want to ensure that the resulting closed-loop system has no fixed modes, as our design guarantee [30]. 
To this end, denote by [M] = {M : Mij = 0 if Mij = 0} an equivalence class of matrices of appropriate 
dimensions. The set of fixed modes of the closed-loop system ([I]) w.r.t. an information pattern K is 
given by ap = flxeix] + BKC) (see [30]), where cr(M) denotes the set of eigenvalues of the 
matrix M. It is known that (see [30]) if, for a non-empty symmetric open set W C C, ap C W (where 
C denotes the set of complex numbers), then there exists a gain K G [K] such that all the eigenvalues 

*The Matlab implementation of the algorithm can be found in https://www.mathworks.com/matlabcentral/fileexchange/49977 


(also known as the poles) of the elosed-loop system A + BKC are in W. Equivalently, we want to 
ensure that the poles of the closed-loop system can be placed arbitrarily by appropriately tuning the 
numerical feedback gain parameters under the obtained (designed) information pattern. 

Yet, in real-world large-scale systems, more often than not, the exact parameters of the plant are not 
available, or may change over time. Hence, to ensure that the desired closed-loop performance guarantees 
as discussed above are met, in this paper we adopt a structural design and analysis viewpoint and aim to 
jointly address the I/O and control configuration (CC) selection such that the closed-loop system has no 
structurally fixed modes (SFMs). The structural version of fixed modes was introduced in [31], which, 
essentially, are the fixed modes attributed to the structural pattern, i.e., location of zeros and nonzeros, of 
a system, as opposed to fixed modes that originate from a perfect canceling of the numerical parameters. 
Specifically, a structural LTI system {A, B,C) is said to have structurally fixed modes (SFMs) w.r.t. an 
information pattern K, i.e., (^4, B, C, K) has no SFMs, if for all A ^ [A\, B ^ [B], C & [C], we have 
+ BKC) # 0. 

Conversely, a structural system (^4, S, (7, K) has no structurally fixed modes, if there exists at least 
one instantiation ^4 e [A], i? e [B], C G [C] which has no fixed modes, i.e., + BKC) = 0. 

In this latter case, it may be shown (see [32]) that almost all systems in the sparsity class (A, B, C) have 
no fixed modes, and, hence, allow pole-placement arbitrarily close to any pre-specified (symmetrical 
about the real axis) set of eigenvalues. This also justifies our constraint of designing systems with no 
SFMs in problem Vi. 

In summary, we choose the non-existence of SFMs as our design criterion because, informally, it 
would imply that all FTI systems represented by {A, B, C) with a given sparsity pattern, i.e., location 
of zeros/nonzeros {A,B,C), have no fixed modes, and, hence, would allow pole-placement arbitrarily 
close to any pre-specified set of eigenvalues. 

Thus, in the present paper, we address the minimal cost constrained I/O and control configuration 
co-design problem stated as follows. 

Problem Statement 

Fet Cu{i) G denote the (non-negative) cost associated with selecting the i\h input Ui (i E X = 
p}), Cy{j) G denote the (non-negative cost) associated with selecting the jth output yj 
{j E J = {1,.. .,m}), and Cf{{i,j)) E M^Ujoo}, with {i,j) eXxJ, denote the cost associated with 
feeding output j to input i, also referred to as communication cost, where = oo if output j' 

is not available to input i' . This paper aims to study the following problem. 


Vi Find the triple {X*, J*, J^*) that solves the following optimization problem: 

min + ^Cy(j) + c/((*,j)) (2) 

I c p} *ex j&J 

J C 

X <z {I xj) 

s.t. (A, B{X), C{J),k{B)) has no SFMs, 

where B{X) corresponds to the sub-matrix of B comprising the columns with indices in X, C{J) 
corresponds to the sub-matrix of C comprising the rows with indices in J, and = 1 if (j, i) G B. 

Due to the combinatorial nature of the FO and CC co-design problems (see for instance [14]) are 
typically solved using a two-step (generally suboptimal) procedure, namely solving first the input/output 
(I/O) selection problem, followed by the control configuration (CC) selection problem. Formally, the 
structural theory counterparts of these problems are given as follows: 

Minimum Cost Constrained I/O selection problem 

Given the structure of the dynamic matrix A G {0,1}"^^”, the structure of the input matrix 
B G {0, and the input costs c„(/), with i = 1,... ,p, the minimum cost constrained input selection 
problem consists in determine X* that solves the following optimization problem: 

min (3) 

Xc p} iei 

s.t. (A,B{X)) is structurally controllable, 


where B{X) corresponds to the sub-matrix of B comprising the columns with indices in X, and a system 
{A, B) is said to be structurally controllable if there exists a controllable pair (Aq, Bq) of real matrices, 
i.e., a system described by these matrices, with zero entries imposed by the zero entries of (^4, B). o 

Minimum Cost Constrained CC selection problem 

Given the structure of the dynamic matrix A G {0, the structure of the input and output 

matrices B G {0,(7 G {0,1}"^^", and the communication costs Cf{{i,j)) G U {cxo}, with 
{i,j) G (X X JT”) = ({1, ■ ■ ■ ,p} X {!,... ,m}), the minimum cost constrained control configuration 
selection problem consists in determine B* that solves the following optimization problem: 


min 

T(Z(X^J) 


CfAhj)) 


s.t. (A, S, G, ii'(X’)) has no SFMs. 


(4) 


o 


III. PRELIMINARIES AND TERMINOLOGY 


We start by reviewing some eomputational complexity concepts [33], followed by some concepts 
related with the study of structural systems theory [13], [6]. 

Computational Complexity 

A (computational) problem is said to be reducible in polynomial time to another if there exists a 
procedure to transform the former to the latter using a number of operations which is polynomial in 
the size of its inputs. Such a reduction is useful in determining the complexity class [33] a problem 
belongs to. Eor instance, recall that a problem V in NP (i.e., the class of non-deterministic polynomial 
algorithms) is said to be NP-complete if all other NP problems can be polynomially reduced to V [33]. 
The set of NP-complete problems is referred to as the NP-complete class. The following result may be 
used to prove the NP-completeness of a given problem. 

Lemma 1 ([33]): If a problem Va is NP-complete, Vb is in NP and Va is reducible in polynomial 
time to Vb, then is NP-complete. o 

The NP-complete class is used to describe the complexity of decision versions of problems. Eor 
instance, the following constitutes a decision problem that is particularly relevant in the structural 
design context: Given A E {0,and B E {0, is there a collection of inputs B(J), where 

J C {1,... ,p} and where B(J) corresponds to the sub-matrix of B comprising the columns with 
indices in J, with \ J\ = k such that (A, B(J)) is structurally controllable? 

Alternatively, it is often natural to consider the optimization versions associated with the decision 
problems. Eor instance, the optimization version of the problem stated above aims to determine the 
minimum k such that the aforementioned property holds. This optimization problem is referred to as the 
constrained minimum structural input selection (CMIS) problem, given by with uniform non-zero 
actuation costs. Note that, if a solution to the optimization problem is known, the decision problem is 
straightforward to solve. Consequently, the optimization problem formulations of NP-complete problems, 
are referred to as being NP-hard, since they are at least as difficult as the NP-complete problems; in 
other words, by solving an instance of the optimization problem (the NP-hard problem), one can obtain 
a solution to an NP-complete problem. 

Graph Theory and Structural Systems 

The following standard terminology and notions from graph theory can be found, for instance, in [6]. 
Let 'D(A) = {X,£a:,x) be the digraph representation of A in (1), where the vertex set X represents the 
set of state variables (also referred to as state vertices) and Sa;,x = {ixi,Xj) : Aji A 0} denotes the 


set of edges. Similarly, we define the following digraphs: V{A, B) = (Af U Su,x) where U 

represents the set of input vertices and Eu,x = {(^j, Xj) : Bji ^ 0}; and 'D{A, B,K,C) = {X UUVJ 
y, Sx,x U Sx^y U Su,x U £y,u) denotes the digraph associated with the closed-loop system, where y 
represents the set of output vertices and Ex,y = {{xi, yj) : Cji 7 ^ 0 } and the set of feedback edges/links 
is given by Sy^^ = {{yi,Uj) : Kji ^ 0 }. 

A digraph Vg = (Vs,i^s) with V* C V and C is called a subgraph of V. If V* = V, Vg is 
said to span V. Finally, a subgraph with some property P is maximal if there is no other subgraph 
Vg! = of V, such that Vg is a subgraph of Vgi, and Vgi satisfies property P. A sequence 

of directed edges {(fi, V 2 ), (^ 2 , v^), - ■ ■ , (ffe-i, Vk)}, in which all the vertices are distinct, is called an 
elementary path from vi to Vk, as well as a vertex in a digraph with no incoming and outgoing edges 
(with some abuse of terminology). A vertex with an edge to itself (i.e., a self-loop), or an elementary 
path from vi to Vk comprising an additional edge {vk,Vi), is called a cycle. 

In addition, a digraph V is said to be strongly connected if there exists an elementary path between 
any pair of vertices. A strongly connected component (SCC) is a maximal subgraph Vs = {Vs,£s) of 
V such that for every v,w G V 5 there exists a path from v to w and from w to v. 

Using the above constructions, we can now present some graph theoretical properties that the digraph 
associated with the closed-loop system V{A, B, C, K) must satisfy to avoid the existence of SFMs. 

Theorem 1 ([34]): The structural system (A,B,C) associated with ([T]) has no SFMs w.r.t. an infor¬ 
mation pattern K, if and only if both of the following conditions hold: 

a) each state vertex x G A” is contained in a strongly connected component of V(A, B, C, K) which 
includes an edge of Eyp, 

b) there exists a finite disjoint union of cycles Ck = {Vki£k) (subgraph of V{A, B,C, K)) with 


k eN such that A C ljJ=i 


o 


The conditions in Theorem [T] hold only if the system is both structurally controllable and structurally 
observably More precisely, we have the following result. 

Proposition 1 ([34], [6]): If (A, B,C, K) has no SFMs, then (A, B) and {A,C) are structurally 
controllable and observable, respectively. o 


A. Optimal Assignment Problem 

The optimal assignment problem consists in determining the collection Ad* of pairs of indices of a 
kxk square matrix H that correspond to the diagonal entries of the matrix P^HP^, where P[ and P 2 

system {A,C) is said to be structurally obserx’uble if there exists an observable pair (^oAo) with zero entries enforced by the 
zero entries in {A,C). 




are permutation matriees such that 


(Pi*, Po*) = ^'I’g Kiiii trace(PiPP 2 ), 

Pi,P2^r 


with V denoting the class of all A; x A: permutation matrices. In what follows, we consider, for the 


optimal assignment problem, block matrices H given by 

j_rX,X jjrX,U TjX ,y 

^TiXn ^nxp ^nxm 

jrU^x jju^u jjU,y 
^pXn ^pxp ^pxm 5 
ffV'.x TTy,u TTy,y 
^mxn ^mxp ^mXm 


H, 


n+p+m 


where the labels of the columns associated with the first block are {xi,..., x„}, the second {ui ,..., tip}, 
and the third {yi ,..., t/m}- Similarly, the labels of the rows associated with the first block are {xi,..., x„}, 
the second {tii,..., tip}, and the third {t/i,..., ym}- For example, the first row and third column of the 
nxn matrix indexed by the pair (xi, X3), and the first row and third column of the nxp matrix 

P“xp is indexed by the pair (tiijXs). Consequently, any solution to the optimal assignment problem 
M* C C X C, where C = {xi,..., x„, tii,..., tip, yi,..., ym}, consists of n + p + m pairs of indices. 

Further, we can associate a matrix H with a digraph representation 'D(H) = (£, S), where S C CxC. 
In particular, a matrix H is irreducible if and only if V{H) is an SCC. In addition, we have the following 
result given by Konig (see Appendix in [35]): 

Proposition 2: Given a square matrix H, where V{H) = {C^S), and a solution optimal assignment 
problem M*, then the digraph V = {C,M*)) corresponds to a disjoint collection of cycles that spans 
V{H). o 

Remark 1: In the sequel, we will use the solution of an optimal assignment problem to establish 
results about V{A, B,C, K), which is mainly possible due to the labeling we chose to the rows and 
columns of the matrix H to be used in the assignment problem, and consistent with some of the edges 
in V{A, B,C, K). In particular, using Proposition [2l we will be able to ensure that 'D{A, B,C, K) 
satisfies condition b) in Theorem HJ o 


IV. MAIN RESULTS 

In this section, we present the main results of the present paper. More precisely, we first show that Vi 
is NP-hard (Theorem O. However, the subclass of problems, in which the dynamic matrix is irreducible, 
is shown to be polynomially solvable, using, for instance. Algorithm 1. The correctness and complexity 
of Algorithm 1 is presented in Theorem [3l Finally, we show how Algorithm 1 can be used to solve 
polynomially the minimal cost constrained FO selection problem as given in and the minimal 

cost CC problem as given in Pp*", if we consider similar assumptions. 

We begin by showing that Pi is NP-hard. 




Theorem 2: The minimal cost constrained VO and control configuration co-design problem, given in 
Vi, is NP-hard. o 

Nonetheless, the fact that a problem is NP-hard does not preclude the existence of a subclass of 
problem instances that are easier to solve. In fact, this is the case when we restrict the structure 
of the dynamics to be irreducible. In Algorithm 1, we present an algorithm to solve Pi, under the 
aforementioned constraint. Next, we provide its proof of correctness and complexity, given in terms of 
a cubic polynomial in the dimension of the state, input and output. 

Theorem 3: Algorithm [T] is correct and its complexity is 0{{n -f m -fp)^). o 

Next, we provide the solution to under the assumption that the structure of the dynamics matrix 
is irreducible, by resorting to Algorithm 1. Notice that this problem is also NP-hard, since we obtain 
the CMIS problem by considering uniform non-zero actuation costs. 

Theorem 4: If A is irreducible, then is polynomially solvable using Algorithm 1, when setting 
C = In (the n X n identity matrix), Cy{j) = 0, with j = 1,... ,n, and Cf{{i,j)) = 0 for {i,j) G X x J". 

o 

Remark 2: By duality between controllability and observability in LTI systems. Theorem |4] readily 
extends to the minimal cost constrained output selection, which consists in determining the minimum 
number of outputs, given a possible configuration of outputs C, that incurs in the minimum cost and 
ensures structural observability. o 

Similarly, we can solve the minimum cost CC selection problem as follows. 

Theorem 5: If A is irreducible, then Pf*- is polynomially solvable using Algorithm 1, by setting 
CuiA = 0, with i e I, and Cy{j) = 0, with j G J”. o 

In the next section, we provide a couple of examples that illustrate the results attained in this paper. 

V. AN ILLUSTRATIVE EXAMPLE 

In this section, we provide two examples where a feasible solution to Pi exists; more precisely, two 
different cases in Algorithm 1 are explored. 

Example 1 

Eet the structure of the dynamics, input and output matrices be given as follows: 



rO 1 1 0 0 On 


rl 1 0 On 



A = 

100100 

100010 

010001 

001001 

, B = 

10 0 0 

0 10 0 

0 0 10 

0 0 0 1 

, and C = 

110000 

101000 

000111 


LOOOIIOJ 


Lo 0 1 1 J 










ALGORITHM 1: Solution to Pi _ 

Input: The structural plant matrices {A, B, C) (with A irreducible), the input costs c„(i) 

(z G X = {1,... ,p}), output costs Cy{j) (J e J = {1,, m}), and the communication (feedback) 
costs Cf{{i,j)) i{ij) eXx J). 

Output: A solution to Vi. 

1. Let 

I 0, if Aij = \ 

[Ca]m = 

I oo, otherwise 

and compute the optimal assignment problem M' considering C^- 

2. If M' incurs in finite cost, then determine 


= arg min c„(z) + Cy(i) + c/((z, j)), 

(i,j)eXxj 

and, if Cu{i*) + Cyif) + Cf{{i*,j*)) < oo, then set X* = {f*}, J* = {j*}, and = {(f*,i*)}, 

otherwise there is no feasible solution; in particular, since the input and output costs are finite, it 
follows that there is no feasible information pattern; 
else consider the following matrix 




'ii^nxp 


c* = 


I* 

^pxp 

^^pxm 


'^^mxn 


I* 

^mxm 


where 



(j)) ^ 

OO, otherwise 




id 


Cy{i), if Cij = 1 

oo, otherwise 


and [CjAij = c/((z,j')), and infinite otherwise. In addition, is the r x r matrix with zero 
entries in its diagonal and infinity in the off-diagonal entries, and oo^xz is the k x I matrix with its 
entries set to infinity. 

Now, compute a solution to the optimal assignment problem M* associated with C*. If M* incurs 
in finite cost, then set X* = {z G X : (wj,.) G M*}, J* = {j E J : (., yj) G M*}, and 

= {(lj) G X X JT" : {yj, Ui) G M*}, otherwise there is no feasible solution; in particular, since 
the input and output cost are finite, it follows that there is no feasible information pattern; 







In addition, let the input costs are given by c„ = [10 10 20 20], the output costs by Cy = [15 15 50], 
and the communication costs by 

K = 


5 oo 25 
cx) 5 25 
20 oo 10 
oo 20 10 


First, notice that A is irreducible, and we can resort to Algorithm 1 to solve Vi. After we execute 
Algorithm 1, the solution obtained is X* = {1}, J* = {1} and X”* = {(1,1)}, illustrated in Figure 1-b) 
by the non-black and non-dashed edges, and incurring in a total cost of 30. 


Example 2 


Let the structure of the dynamics, input and output matrices be given as follows: 
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In addition, let the input costs are given by c„ = [5 10 10], the output costs by Cy = [10 10 1], and the 


communication costs by 


K 


10 10 CX) 
100 oo 30 
oo 100 30 


First, notice that A is irreducible, and we can resort to Algorithm 1 to solve Vi. The solution obtained 
is X* = {1,2,3}, J* = {1,2,3} and T* = {(2,1), (3, 3), (1, 2)}, illustrated in Figure 2-b) by the 
non-black and non-dashed edges, and incurring in a total cost of 186. 



Fig. 1. In a) we depict the digraph representation associated with C* defined upon the parameters given in Example 1, where a possible 
solution to the optimal assignment problem is depicted by the red edges. In b) we provide ©(T, B{T*), K[T*)) accordingly with 

the triple {T*, J*, F*) determined by Algorithm 1, where the inputs and outputs with dashed edges have not been selected. In addition, 
we depict by the bold arrows the disjoint union of cycles in ©(A, B, C, K) that contains all x-vertices, and the SCC containing at least 
an edge of the form {yj,Ui), as required by Theorem 1-b) and Theorem 1-a), respectively; hence, Theorem 1 holds, and the closed-loop 
system {A, B, C, K) has no SFMs. 

















Fig. 2. In a) we depict the digraph representation associated with C* defined upon the parameters given in Example 2, where a possible 
solution to the optimal assignment problem is depicted by the red edges. In b) we provide K{F*)) accordingly 

with the triple {T*, J*, F*) determined by Algorithm 1. In addition, we depict by the bold arrows the disjoint union of cycles in 
B,C, K) that contains all a;-vertices, and the SCC containing at least an edge of the form {yj,Ui), as required by Theorem 1-b) 
and Theorem 1-a), respectively; hence. Theorem 1 holds, and the closed-loop system (A, B,C, K) has no SFMs. 


VI. CONCLUSIONS AND FURTHER RESEARCH 

In this paper we have shown that the minimal eost eonstrained I/O and eontrol eonfiguration eo-design 
problem is an NP-hard problem; henee, effieient algorithms are not likely to exist. Nevertheless, this 
does not preelude the existenee of elasses, where it is possible to determine solutions effieiently. In faet, 
we provided a systematie method with polynomial eomplexity (in the dimension of the state, inputs 
and outputs) to jointly solve the input-output and eontrol eonfiguration seleetion problem that ineurs in 
a overall minimal eost, under the assumption that the strueture of the dynamies matrix is irredueible. 
Euture researeh will eonsist of determining other subelasses of interest where the eurrent problem ean 
be effieiently solved. 


Appendix 

Proof of Theorem |2] 

To prove that Vi is NP-hard, we provide a reduetion from a known NP-hard problem, the CMIS (see 
Seetion II, problem V\°), to a partieular instanee of Vi when the eosts (input/output/eommunieation) are 
equal and uniform, whieh we refer to as Vf Consequently, the eorresponding deeision problems ean be 
polynomially redueed to eaeh other, and the result follows by invoking Lemma [T1 Eirst, we notiee that it 
is possible to polynomially verify if a solution to V[ is feasible, and, eonsequently, to the eorresponding 
deeision problem, see, for instanee [25]; henee, the deeision version of P[ is an NP problem. Now, 
we eonstruet a polynomial reduetion from the CMIS problem to Vf Towards this goal, let A, B and 
Cu{i), / G X = {1,... ,p}, in V[ be the same as in the CMIS problem. In addition, let (7 = be the 




n X n identity matrix, Cy{j) = 0 for j e J” = {1,..., n} and Cf{{i,j)) = 0 for {i,j) G X x J". To see 
that a solution to the proposed problem V[ provides us with a solution to CMIS, recall that a feasible 
solution to V[, i.e., {A,B,C,K) without SFMs, implies that {A, B) is structurally controllable (see 
Proposition 1). Now, to see that B(X*) in V[ is also a solution to CMIS, let us assume, by contradiction 
that it is not. Then, there exists X' such that B(X') incurs in a lower cost than B(X), and such that 
{A, B{X')) is structurally controllable. Now, because C is the identity matrix and K can be full without 
increasing the cost, it follows that there exists a collection of cycles that comprise the inputs labeled by 
X', as well as a set of labels for the outputs and feedback given by J' and B', respectively. However, 
this collection of cycles provides with a solution Jvi' to the optimal assignment problem that incurs in 
lower cost than Ad*, which is a contradiction since we assumed that Ad* is a solution to the optimal 
assignment problem. ■ 

Proof of Theorem |i] 

As discussed in the preliminaries, a solution Ad* to the optimal assignment problem of C* al¬ 
ways provides a collection of n + m + p pairs of labels of the form Ad* C C x C, where C = 
{xi,..., Ml,..., tip, pi,..., Pm}- Subsequently, by construction of C*, if the weight-sum cost of the 
entries in C* labeled in Ad* is finite, then there exists a collection of disjoint cycles in the digraph 
representation of C* (see Proposition 2). Now, notice that by construction, only edges associated to 
finite entries in C* are used; hence, the cycles comprise only edges of the form {xi,Xj), {ui,xf), 
(xj,pj), {yj,Ui), as well as {ui,Ui) and {yj,yj). Further, the latter edges {ui,Ui) and {yj,yj) do not 
contribute to ensure either condition a) or b) in Theorem 1, nor are they represented in 'D{A, B, C, K); 
hence, they can be neglected from the analysis. Subsequently, by noticing that if any edge of the form 
{ui, Xj), (xj, yf), {yj, Ui) belongs to Ad*, then so are the other two, otherwise. Ad* does not comprise a 
family of cycles with finite weight. Nonetheless, it might be the case that there is no edge of the form 
{ui, Xj), (xj, yj), (yj, Ui), that corresponds to the case where Ad' incurs in finite cost, which implies that 
there exists a disjoint union of cycles comprising only vertices with labels {xi,..., x„}; subsequently, 
all edges of the form {uj,Uj) and {yk,yk) are used in Ad*. In this case, the weight-sum of Ad* is 
equal to zero and, although condition Theorem 1-b) is satisfied, it follows that there is no edge of the 
form (pj, Uj) in the SSC containing the state variables in V{A, B, C, K). To preclude this case, if Ad' 
incurs in finite cost, we consider the triple (.B({z}), (7({j}), .A({(i, p)})) that incurs in the smallest 
cost; hence, condition Theorem 1-a) is satisfied, and Theorem 1 holds. Alternatively, if M' does not 
incur in finite cost, then additional edges that are not of the form (xj,Xj) are required to be associated 
with a solution to the optimal assignment problem, as result of Proposition 2. Further, both conditions 


in Theorem 1 are satisfied: more preeisely, a) is satisfied sinee V{A) is an SCC (by assumption), and 
there must exist at least an edge of the form {yj, Ui) in M*, as well as in V{A, B{X*),C{J*)-> 
obtained using Algorithm 1. On the other hand, Theorem 1-b) is satisfied by considering, the edges of 
a solution to the optimal assignment problem used to define V{A, 

Finally, we notice that the algorithm’s complexity is 0{{n + m + p)^), since it is the complexity 
of applying the Hungarian algorithm to the optimal assignment problem associated with C*; all the 
remaining steps have lower complexity which renders them moot to the final complexity. ■ 

Proof of Theorem |4] 

First, we notice that since A is irreducible, from Theorem [3l it follows that Algorithm 1 determines 
the optimal solution to Vi. Further, if {A, B,C, K) has no SFMs, then it is structurally controllable 
and observable (see Proposition 1). Because we have that the system is structurally observable and all 
outputs can be fed to all inputs without increasing the cost, it follows that the problem consists in 
determining the collection of inputs that incurs in the minimum cost; hence, by noticing that this is the 
same as the "Pf®, the result follows. ■ 
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